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ABSTRACT 



A COMPUTER ASSISTED LITERACY DEVELOPMENT 
PROGPJ\M FOR CAREER ORIENTED YOUTHS. AGES 14-24 

Lester S. Golub 
Principal Investigator 
The Pennsylvania State University 

The purpose of the project was to develop and validate a comouter assisted 
literacy development program for career oriented youths, ages 14-24. This goal 
has been accomplished so that there now exists a model for a total computerized 
reading program for young adults. The end product of this program consists of 
adult diagnostic reading level tests, an occupational interest inventory, and 
instruction in literacy and occupational information. 

Several stages of development were required to produce the LITE program 
on the IBM 1500 Instructional System. The summative evaluation of the program 
showed that students participating in the LITE program made considerable gains 
in their literacy development and outstanding gains in Information about career 
information. The attitude of students in the CAI mode of the program was signi- 
ficantly better than that attitude of students taking a programed text version 
of the program. 

Since the LITE program is successful, it is suggested the funds become 
available to bring the program to a large number of students, that materials on 
the world of work and code-breaking skills be brought to special education and 
adult basic education persons, and that the career information areas be further 
developed to meet the vocational needs of career-oriented youths. 
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CHAPTER ONE 



PROBLEM, ACTIVITIES, AND IMPLICATIONS 

Introduction > Problem , 
and Overview 

Illiteracy and low levels of literacy haunt the American educational scene. 
It is estimated that there are currently about 15-20 million adult illiterates 
and semi -literates in the United States. These persons have a level of lit- . 
eracy so limited that it makes normal reading and writing functions virtually ^ 
impossible. The chances of an Illiterate or semi -literate person functioning as a 
productive citizen are slight considering the career demands of our highly lit- 
erate, industrial society. The largest numbers of illiterate and semi -literates 
are to be found in the poverty pockets of our large cities. In the South, and 
in isolated rural regions such as the Rio Grande Valley and Appalachia. Much 
has to be done in the United States to increase the literacy level of young 
adults In high schools and- junior colleges who have motivation and ability to 
become productive ci ti zens . 

The term "literacy" Is used in this context to include the ability to read 
with a standard of easo and fluency expected of an Individual in a career^ 
oriented world. This Computer^ Ass is ted Literacy Development Program for Career- 
Oriented Youth and Adults has been developed with the aim of involving the con- 
tent of career information in improving the literacy level of youths and adults 
(ages 14-24} with limited- literacy levels. 

The purpose of developing this program In the computer assisted mode is to 
create an Instructional system that has extensive flexibility, that can be used 
by teachers without specific training in reading instruction, that can be used 
in remote educational settings at times convenient to the learners. The com- 
puter assisted mode of instruction offers a teaching medlur-i which is generally 
different from the traditional classroom Instruction to which these students 
are accustomed. The student is not frustrated by trying to keep up with his 
classmates or having to read in disruptive environments. The student has audio 
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and visual aids to assist his reading comprehension. He has built-in inter- 
active activities and immediate feedback for remediation. The student is 
placed, immediately, at his level of reading ability and career interest. The 
student has flexibility In selecting his study periods. 

The broad objectives of this program are summarized as follows: 

lo To develop a career-oriented reading literacy course of instruction 

for youths and adults (ages 14*24). 
2. To provide career-oriented students with knowledge of a variety of 
careers withTh their Interest and educational ability. 

Justification and Purpose 

Illiteracy continues to be a problem in the United States. The Survival 
Literacy Study (Louis Harris and Associates, reported in the Congressional 
Record, November 18, 1970, pp. E9719-E9723) asked the question: "How many 
Americans were prevented by reading deficiencies . . . from filling v}ut appli- 
cation forms for such common needs as Social Security number, a personal bank 
loan. Public Assistance, Medicaid, a drivers license?" The outcomes of this 
study indicated an estimate that 13 per nent (18.5 million) of American adults 
failed to fill out the forms with fewer than 10 per cent errors, while 3 per 
cent (4.3 million) missed more than 30 per cent of the items (an item being a 
blank on a form). 

Another study reported by the Department of Defense (1968) indicates 
that, of a group of 46,000 men who scored below the twentieth percentile on 
the Armed Forces Qualification Test (AFQT), 43 per cent had completed high 
school, yet 90 per cent read at or below the eighth grade level. Completion of 
high school does not guarantee optimal reading ability. 

Defining functional literacy in terms of job related literacy demands, 
rather than in terms of representative reading tasks performed by aduHs, 
serves two functions: 1) it suggests targeted skill levels for adult basic 
training geared toward employment, and 2) an examination of the literacy 
demands of jobs indicates whether or not the stated literacy requirements of 
jobs are unnecessarily high. 
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Increasing concerns for employing the "hard-core" unemployed, have led 
manpower specialists to suggest that employers re-examine their educational 
requirements In the light of actual job demands (Wienrr, 1SS&). The research 
reported here addresses iteslf to the problem of dev^^l oping the literacy skills 
of the potentially "hard-core" unemployed so that they can handle the literacy 
demands of a set of jobs which employs a large number of the work force. The 
purpose of this study Is also to Increase the Information about this set of 
jobs for this potential population. 

Target Population 

The materials developed for this study are designed for potentially "hard- 
core" unemployable. Illiterate and semi -literate youth and young adults. The 
materials were designed for an Interest level of 14-24 year-olds, aUhuugh one 
50-year-old, 1 1Tv^eraie jaiTitor has successfully worked his way through a large 
portion of the program and has learned to read with the use of the program. The 
question of career choice for him, however, was of little Importance since his 
career goals will not change at the age of 50. The job Information for the 
targeted population was an Important motivational factor. In the formative and 
summatlve evaluation portion of this study, the population Included high school stu- 
dents Identified by the school counselors as having a reading level of fifth 
grade or below and who would profit from reading Instruction and learning about 
the career areas as described in the materials. 

The subjects used in this study for both the formative and summatlve valida- 
tions of the program were enlisted from the following five hiqh sc^lOo1s in 
Centre County, Pennsylvania: 

1. Bald Eagle Area High School 

2. Be lief onto Area High School 

3. Penns Valley Area High School 

4. Philipsburg-Osceola Area High School 

5. State College Area Senior High School 

All subjects ranged in age from 14 to 18 with sixteen years as a mean age. 
All students were from middle and lower-middle income families. 
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Developmental Procedure 

The Computer- Ass is ted Literacy Development Program, henceforth called LITE, 
taken from the first four letters of literacy , was conceived and developed by a 
team of elementary, and secondary reading teachers and vocational education 
teachers, under the direction of Lester S. Golub, Professor of Education at The 
Pennsylvania State University. Thomas Long, Associate Professor of Vocational 
Education served as a consultant in career information. The team of research 
assistants used the PERT chart (see Figure 1) as a means for identifying and 
accomplishing events in the developmental procedure. The main steps of the 
developmental procedure include: 

1. define project objectives 

2. select evaluation instruments 

3. establish teaching objectives and strategies 

4. select career areas 

5. research job areas 

6. author job areas 

7. prepare images 

8. formative evaluation 

9. revise and correct units 
10. sunmative evaluation 

The «App roach and the_ Scope of 
the Projected Outcome 

Educators have long been concerned with the problem of how reading in uc- 
tion and vocational information can most effectively be practiced in the pub/ic 
schools. In recent years, attempts have been made to improve instruction 
through the process of individualization. Individualized instruction adjusts 
to individual progress in the sub-skills by teaching to points of weakness; it 
provides more opportunities for interaction and feedback from the teacher 
than do group analysis techniques (Evans, 1962). Thirty-three research studies 
comparing individualized and ability grouping approaches indicated that chil- 
dren taught by individualized reading instruction do at least as well on 
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achievement tests as those who experienced more traditional grouping plans, and 
many reported greater achievement in individualized classes (Groff, 1964). 

These investigations indicate that instruction becomes more effective as 
it is more adequately adjusted to the student's level of achievement, interest, 
and needs. Teachers, however, are frequently concerned about the best ways to 
organize a class for individualized instruction and what materials best facili- 
tate such an approach. Computer-assisted instruction tends to offer great poten- 
tial for individualized reading instruction and vocational information. 

Research done at Stanford University has produced significant posttest 
gains in reading achievement (Fletcher and Atkinson, 1972). Hawkin, Smith, and 
Smith (1967) have also found the computer to be an extraordinary flexible and 
capable device for improving the reading abilities of disadvantaged youths and 
adults. Majer (1972) reviewed several research reports of programs using com- 
puter-based systems and found that programs under computer control not only 
resulted in significant gains in reading achievement but also had a noticeable 
effect on learner attitude. Majer (1972) also revealed overwhelming acceptance 
of computer assisted instruction in place of a teacher. 

The result of the search of t!ie literature on adult literacy, career educa- 
tion, and the computer are reflected in the bibliography of this text. Tradi- 
tionally, career-education and literacy have been considered as two separate 
educational domains. Computer-assisted reading instruction is primarily the 
result of research with elementary school children (Suppes, 1967). The search 
of this literature furnished us with essential background material. 

The proposed outcomes of this study are an attempt to individualize an 
adult reading program which is relatively teacher-proof and to present career 
information to potentially hard-core unemployed youths. 

The outcomes of this program are a completely documented CAI literacy 
program for semi -1 1 terate youths, ages 14 to 24, summative evaluation data on 
the effectiveness of this program, and suggestions for further development, 
research, and Implementation. 
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CHAPTER TWO 
COURSE DESCRIPTION 

Purpose 

The purpose of this CAI program is to develop the reading power and voca- 
tional information of illiterate and semi -literate youths. 

The course is appropriate for high school age and young adults who have 
not learned to read at a functional level. A functional level of literacy would 
start at a fourth or fifth grade reading level, with ability to read accurately 
at that level. 

The developmental steps of this program consist of: 

1. refining of objectives and research methodology; 

2. research on adult literacy-career description and choices, and computer 
programing and authoring; 

3. task assignments and the writing of LITE modules; 

4. formative evaluation for content and strategy editing; 

5. small scale summative evaluation to determine effectiveness of the 
program on a sample population. 

Refining Objectives 
and Research MethodTology 

Although the research proposal for a literacy development program for 
career oriented youth was well developed, it was too extensive for the money 
finally granted the project. One main decision was to limit each phase of the 
program to its base essentials. The objectives of LITE (J consisted of the 
following: 

1. to teach Ss^ how to use the computer student station; 

2. to teach Ss^ the alphabet; 

3. to gather biographical data about, and by the student on the computer. 
The objectives for the testing component of the program were to be able: 
1. to detennine the entering and and exit reading ability of the student 

on a standardized test; 
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2. to place the student In the appropriate LITE I or LITE II segment. 
The objectives for the LITE I segment of the program are: 

1. to teach code-breaking skills; 

2. to teach job-world survival skills; 

3. to bring reading ability up to a grade 4 level. 

The objectives of the LITE II segment of the reading program are: 

1. to provide job duties, training, and advantages for job areas 
including: 1) orderly, 2) nurse aide, 3) auto mechanic, 4) waiter, 
5) chef, 6) file clerk, and 7) receptionist; 

2. to provide reading activities for improvement in a) comprehension, 
b) vocabulary and language skill, and c) inferencial skill; 

3. to bring reading ability up to functional level—about 8th grade. 

Task Assignments and 
WrTting of LITE Modules 

The following assignment of tasks assured the completion of the program: 

1. One project director: Lester S. Gtolub 

2. One project coordinator: Robert Caldwell 

3. Five half-time authors: Dona Prall, Maura Clancy, Ruby Thompson, 
Pat Mull, William Beaman 

4. Two full time programers: Tom Emery, Marsha Young 

5. One clerk/ typist 

6. Technical support from CAI Laboratory, especially for graphics, audio, 
and accounting assistance. 

The development and explanation of the student flowchart (Figure 2), helped 
determine the modules and their content. 

Relation of Objectives to the 
Decision Hiking Process 

The objectives of the LITE program are directly relatad to the steps in 
the student flowchart (Figure 2). The first five steps of the flowchart are 
related to data gathering and diagnosis of the SJ^ literacy level and vocational 
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interest. This evaluation determines which level of the LITE pronram the stu- 
dent is prepared, from past exoerience, to enter. Evaluation should be thought 
of as a continuous process which is an inteqral part of the total educational 
effort. This evaluation process deals with three asoects: 1) the literacy 
development as determined on a standardized ttJt, 2) the S's progress in the 
criterion referenced tests related to each unit of instruction, and 3) the 
acquisitic if new information about a vocational tonic. As information Is 
obtained on the student's nroqress in these three areas of evaluation, deci- 
sions appropriate to new qoal setting for the student can be made. 

Steps 6 through 17 of the student flowchart deal with the progress 
through the initial code breaking orocess and the job-world orientation reading 
materials. 

Steps 18 through 21 deal with the Vs^ progress in the LITE I materials and 
the decision to send him into LITE II. Steps 22 through 42 deal with the S^ 
job area decisions and his progress through the vocational areas. This tyoe of 
student flowchart with its internal evaluation and decision making points 
provide the researchers with a program which could be administered without a 
teacher* The program has been successfully administered to high school youth, 
mature blue collar workers, and slightly mentally retarded youth without the 
use of a reading teacher. Once the student has signed on to the program, either 
he or the program will make decisions which will carry the through the mate- 
rials at the appropriate difficulty level for the S. 

Structure of LITE Program 

For pedagogical identification and administrative ourooses, the LITE oro- 
gram is divided into four segments with each segment having its subdivisions. 
The general structure is shown in the following Outline of LITE. 

Outline of LITE 

Segments 
I. LITE 9 

A. Biographical Information (student data) 

B. How to (use the equioment at student terminal) 

C. Learning the alphabet and the keyboard 
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II. Tests 

A. Select ABLE (Adult Basic Learning Examination) 

B. ABLE I, forms a^ and (vocabulary and reading) 

C. ABLE II, forms a and (vocabulary and reading) 

D. Gordon Occupational Check List 

III. LITE I: Initial Literacy Development, Grade Level 1-3 

A. Phonemic Code-breaking skills 

1. Single consonant instruction and evaluation 

2. Single vowel instruction and evaluation 

3. Sight word instruction and evaluation 

4. L^ blend instruction and evaluation 

5. R blend instruction and evaluation 

6. S^ blend instruction and evaluation 

7. TW blend instruction and evaluation 

8. Adjacent vowel instruction and evaluation 

9. Final e influence instruction and evaluation 

10. Vowel digraphs instruction and evaluation 

11. Consonant digraphs instruction and evaluation 

12. Syllabication instruction and evaluation 

13. Silent letter instruction and evaluation 

B. World of Work Orientation Reading List 

1. Getting a job 

a. How to apply 

(1) Letters of application 

(2) Teleohone inquiries 

(3) Personal interviews 

b. Where to aooly 

(1) Personnel office 

(2) Whom to see in a personnel office 

2. Benefits and deductions 

a. Social Security 

b. Hospitalization 

c. Tax deductions 
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3. Necessary documents 

a. Birth certificate 

b. Working permit 

c. Health certificate 

d. Social Security 

Lite 11: Occupational Area Description, Grade Level 4»8 

A. Orderly 

1. Duties and requirements 

2. Training 

3. Advantages » disadvantages, opportunities 

B. Nurse aid 

1. Duties and requirements 

2. Training 

3. Advantages, disadvantages, opportunities 

C. Chef 

1. Duties and requirements 

2. Training 

3. Advantages, disadvantages, opportunities 

D. Waiter 

1. Duties and requirements 

2. Training 

3. Advantages, disadvantages, ooportunities 

E. File clerk 

1. Duties and requirements 

2. Training 

3. Advantages, disadvantages, ooportunities 

F. Receptionist 

1. Duties and requirements 

2. Training 

3. Advantages, disadvantages, opportunities 
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G. Auto mechanic 

1. Duties and requirements 

2. Training 

3. Advantages » disadvantages » opportunities 

H. Logger 

1. Duties and requirements 

2. Training 

3. Advantages » disadvantages » opportunities 

The program is introduced by Segment I» called LITE (9. This segment is 
designed to familiarize the student with the various parts of the comouter 
terminal at the student station (the CRT, the image projector* the audio unit» 
and the earphones) and with the method of resoonding (the keyboard and the liqht 
pen). In this on-line seqment the student provides biogranhlcal data (name» 
address » years of school) needed for record keeping* progress reoorts* and other 
official requirements. Since the students using this seqment have been identified 
as illiterate or semi-literate» all of the instruction had to be presented in 
the audio mode as well as the visual mode. All directions had to be simollfled 
and easily understandable. This seqment also utilized the keyboard in order to 
teach the totally illiterate student the large and small letters of the alphabet 
as they appear on the typewriter keyboard. The reader must bear in mind that most 
illiterates have little or no familiarity with the alphabet. 

Segment II » called lest, provides for a self-adjusting, testing, and 
evaluation of the student. After the student has learned how to use the student 
computer terminal equipment, has supplied the computer with the necessary biograohical 
information, and recognized the large and small letters of the alphabet, he then 
moves on to a series of tests. His first test is the Select ABLE, a preliminary 
test which establishes whether he takes the ABLE I pretest or the ABLE II pretest. 
If the student gets a score of fifteen or hic](her on the Select ABLE, he proceeds 

u 

to the ABLE II pretest. If the student's number correct score is below fifteen 
he takes the ABLE I pretest. Research data was gathered on the scores of the 
ABLE I and ABL£ II tests. 
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ABLE I is constructed to test the vocabulary and comprehension skill of an 
adult student reading at a first through third grade reading level. ABLE II is 
constructed to test the vocabulary and comprehension skill of an adult student 
reading at a fourth through six grade reading level. The ABLE tests were con- 
sistent with the goals of the LITE materials since they tested vocabulary, 
language skill, and comprehension. All criterion- referenced test and question 
materials developed in the LITE program were coded for reference to vocabulary, 
language skill, or comprehension. Interpretation of information was included 
under the comprehension category. 

A student reading at the fourth grade level or better was also given the 
Gordon Occupational Check List ~ an interest check list desiqned for high school 
students who will not go on to coUeqe. The Gordon Occuoational Check List affords 
measures of student interests in five ma.ior occupational areas: 1) business, 
2) outdoors, 3) arts, 4) technology, and 5) services. When the student completes 
the Gordon Occupational Check List he is given a choice of occupational areas to 
read about which are at his reading and interest levels. 

Once a student completes the pretest, ABLE I or II, Form A, and the 
Gordon Occupational Check List for students reading at above the fourth grade 
level, they then continue with LITE I or LITE II instructional material. 

LITE I teaches sound to letter correspondences, reading of short sentences 
and short paragraphs dealing with orientation to the world of work: 1) getting 
a job, 2) benefits and deductions, and 3) necessary documents. In order to 
present a variety of materials it was decided to intersperse the reading pool 
of work-world orientation within the sound- to -synfcol materials. However, it 
was difficult to coordinate the code breaking instruction with the words needed 
in the simple reading pool. It has subsequently been useful, in using these 
materials with a larger institution such as Elwyn Institute to sort out the 
work-oriented reading pool materials and to place them in a segment of their 
own. The information in these materials can then be used in basic adult educa- 
tion classes without going through the code breaking materials. 

The LITE II materials are extensive. Each segment ranges from forty- 
five minutes of instructional time to two hours of instructional time. Deoending 
upon the progress and branching of the individual student. Vocabulary, language 
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skill, and comprehension questions are coded so that students' weaknesses 
can be diagnosed. Only a small number of job areas wera developed for this 
area. Students requested some job areas which had not yet been developed. 
A further needs assessment and further develooment of job areas should be 
considered for various types of students. 

After an average of about 500 minutes, about 8 hours of instructions in 
the total LITE program, students then took their ABLE I or II posttest, form b. 

Gordon Occupational Check List 

The Gordon Occupational Check List (Dr. Leonard V. Gordon, Test Deoartment, 
Harcourt, Brace and World, Inc., 757 Third Avenue, New York, New York, 10017, 
permission obtained for use on CAI research), has as its objective, the matching 
of the individual with an occupation or with a set of occupations. The assump- 
tion is that most people are capable of performing successfully in literally 
hundreds of occupations, but generally are interested in only a few. The Check 
list examines only a student's interest and not his abilities. The content of 
this check list is specifically relevant to non-college bound young men and 
women who will leave high school to enter the world of work. In theory, the 
Check List directs the student to occupations for study. For example, uoon 
completion of the Check List, the student receives a statement such as, "You 
appear to be interested in outdoor work, please select one of the job areas 
for further study." 

A choice display such as: farmer, logger, nursery worker, will aooear on 
the CRT. The student makes his choice and starts tne LITE II reading materials. 
A student may not have a dominant interest as reflected by a larrje number of 
different types of items on the Check List. In such a case he will be told 
this and asked to choose a selection from a variety of job areas. For the 
purpose of this study students started with a job area closest to their interest 
and then, time permitting, mDved on to another job area. 

The Adult Basic Learning Examination 

The Adult Basic Learning Examination . ABLE . (Karlesen, B., Madden, R. and 
Gardner, E., Harcourt, Brace and World, Inc., Test Department, 757 Third 



ERIC 



17 



Avenue, New York, New York* 10017, permission granted for CAI research) was 
adapted to the CAI mode for administration. The vocabulary and reading portion 
of ABLE I and II, Forms A and B^were used for this research. ABLE is an 
achievement test designed specifically for adult basic education grouos. It 
secures interests and motivates performance because It poses questions in an 
adult context. ABLE I measures achievement Grades 1-4; ABLE II measures 
achievement. Grades 5-8. 

In ABLE I and II the student's vocabulary Is assessed independently of 
his reading ability- The vocabulary test is dictated In its entirety. The 
vocabulary test contains 50 mu1tlDle-*choice Items in which the student 
listens to sentences where three alternatives are given for the last word in 
each sentence. He must choose the correct word with his light pen. He is not 
required to read a single word* The Items of the vocabulary test covers a wide 
variety of subject-matter content. Each item tests for a common meaning of a 
given word, the distracters represent common misconceptions about these works, 
and they are of equal or lesser difficulty than the test word. 

The reading test of ABLE I and II determines how well the student can 
understand the meaning of sentences and paragraphs which he reads. The test 
consists of paragraphs of gradually increasing length and difficulty. He 
responds by selecting one of three choices for a missing word or phrase. 
Although the reading paragraphs contain a great variety of content, there is a 
heavy emphasis upon the every day life of adults. The vocabulary load is 
adjusted so as to avoid having another vocabulary test. This reading test is 
best used to place a student at a proper instructional level. 

There were 50 multiple-choice vocabulary items and 51 multiple-choice 
reading comprehension items, a total of 101 items used for ABLE I, Forms A and 
B. There were 50 multiple-choice vocabulary items and 58 multiple-choice reading 
comprehension Items, a total of 108 items used for ABLE II, Forms A and B. 
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CHAPTEii THREE 

COMPUTER-ASSISTED INSTRUCTION IN 
LITERACY DEVELOPMENT AND CAREER INFORMATION 



CAI Potential for 

Tiachtng Literacy and Career Information 

At first glance it appears presumptuous tc hypothesize that youths 
between the age of 14 and 24 who have come through their public school experi- 
ence as illiterates or semi -literates are miraculously going to improve their 
reading ability by using the CAI mode of instruction. Yet, considering the 
pattern of response to the educational experience which these students habitually 
display, there is every reason to believe that a mode of instruction different 
from the patterns established in the traditional school setting will benefit 
these students. 

Consider their instructional dilenma. These students have failed to learn 
to read adequately in the elementary school. Not being able to master aca- 
demic subject matter in junior high school they learn how to avoid activities 
which demand a high level of activity. If they remain in school past the com- 
pulsory age, these students will be found in a situation where they are working 
part time and attending basic education classes a minimal part of the time. 
One hour spent with these students in a reading or English classroom will 
reveal that at least 80 percent of the instructional hour has been wasted in 
banter and minor disciplinary disruptions. A teacher who has made a peace with 
these students might strike a more favorable instruction-to-time wasting ratio. 
However, it is difficult for academically oriented teachers and non-goal directed 
students to reach this peace. 

The computer offers an immediate change to this traditional setting. In 
the CAI environment the gregarious student is by himself confronting the com- 
puter even though a classmate is sitting right next to him. Because each stu- 
dent can learn from and Interact Independently with the CAI program, and 
because the computer program can execute logical decisions based on the analy- 
sis of Incoming on-line student performance data, there is built into the LITE 
program Intelligent adaptation of Instruction to the needs of each student. 
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The logical decision making ability of the computer program, Its extremely 

rapid access to large amounts of stored information, and the knowledge and 

skill of content authors and computer programerss cat provide for a wide 

variety of individual differences among learners. Mitzel (1967) states: 

Indeed, in sophisticated tutorial programs which Involve many 
remedial branches and frequent examination of the learner's mastery, it 
is likely tiiat no two learners in a group will ever take the same path 
through the material. In the tutorial mode, maximum adaptation can be 
made to individual differences exhibited by the learners (Ftitzel, 1967, 
p. 5). 

Computer-assisted instruction has the following advantages (Dick, 1965, 
p. 51) over traditional instruction: 

1. The computer can carefully control the learning sequence of the stu- 
dents; in fact, it forces the student to comprehend each frame. It 
also prevents cheating. 

2. The computer can judge constructed responses for accuracy. When 
several answers are acceptable, the student is not left wondering 
whether his response is correct or incorrect. 

3. The computer may offer a more stimulating learning situation than the 
dull one sometimes provided by programed texts. 

4. The computer can utilize background information on each student, 
including both personality traits and abilities, for constructing 
learning sequences and judging responses. 

5. The computer is more versatile than the programed text. It can teach 
a wider variety of tasks and employ a wider range of auxiliary 
stimulus-presentation equipment. 

6* The computer offers data on the entire learning session as well as 
summary data. These data are useful both for school records and for 
research purposes. 

1. The computer can be used for a multitude of jobs besides instructing. 

Grades, reading rate, attendance, on-line time, trials, inventories, 

and scheduling can be processed on the computer. 
8. The computer, unlike the teacher is never tired, short tempered, 

bored, and as a long term Investment, is less exoensive than teachers, 

books, or programed texts. 
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Still other considerations put a plus on computer-assisted instruction. 

1. Use of CAI can generate a unique motivational environment. 

2. Student populations of widely varying backgrounds can be brought 
together in the same environment and helped to achieve recognized 
literacy standards. 

3. Students with lower literacy ability can be stimulated by controlling 
the success ratio and maximizing the learning reinforcement. 

4. Student programs and teacher programs can be made available with the 
same CAI system. 

5. Updating or changing the CAI program can be accomplished with relative 
ease. 

6. Uniform standard of course quality control and student management is 
maintained in every location where the course is offered. 

With these advantages in mind, it appeared to the researchers that the 
wish of increasing literacy levels of illiterate and semi-literate youth was 
worth the attempt. If such a system seemed to present some progress in the 
direction of making these youth productive and literate citizens, the program 
and the computer could then be used for further research and develooment. There 
is little question that the computer and well conceived programs will play an 
increasingly important role in the future of education. 

Modes for Teaching 
Literacy Slcills with CAI 

The LITE program used a comprehensive set of instructional strategies to 
assist the student to increase his literacy level and to offer him new career 
information. All of the strategies force the student to interact with the 
course materials and to participate in the learning process. 

The most prevalent strategy is the use of the tutorial mode of instruc- 
tion. This instructional mode simulates the master tutor engaging in an 
interactive dialogue with the individual learner. The tutor presents informa- 
tion, asks penetrating questions, and carefully analyzes the student's resoonses 
to the questions. On the basis of the student's demonstrated understanding or 
lack of understanding or skill, the tutor assists in establishing new goals or 
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tasks for the student. In the teaching of literacy skills, the tutor can move 
an advanced student through the prog>am faster than he can move a less skilled 
student. The computer can be a tutor for dozens of students at various levels 
of literacy. 

The second instructional strategy is the inquiry mode. This situation 
also provides simulation of various career situations. This type of activity 
is used in the LITE II, career information portion of the program. With the 
use of illustrations and audio, the authors have attempted to reproduce experi- 
ences in the automobile garage, at the receptionists desk, and in the hospital. 
The inquiry and simulation modes are used in the LITE program for inference and 
problem solving. A student is given a problem which a receptionist might 
encounter in a day's work such as the need to alter appointment times or to 
screen incoming telephone calls for her employer. Given a number of choices, 
the student must select the most feasible possibility. If a false assumption 
is made because of faulty reasoning, faulty information, or insufficient or 
inaccurate literacy skills, the program allows the student to follow another 
strategy until the correct decision is made. Eventually, the student learns to 
attend to careful reading and interpretation of the content. The student's 
decisions and corrective strategies are recorded and evaluated by the computer. 

The CAI Equipment 

The Pennsylvania State University Computer Assisted Instruction Laboratory 
utilizes the IBM 1500 Instructional System. The CAI Laboratory is located in 
the Chambers Building of the University Park Campus of The Pennsylvania State 
University. Each of the 30 Instructional stations contains a cathode ray tube 
displaty, a light pen, a typewriter keyboard, an audio/record unit, and an image 
projector. * 

The cathode ray tube (CRT), a small television tube, is the most important 
device at the student station. This device is the main interface between the 
Student and tiie computer. Lines of text, special alphabets and symbols, and 
specially designed line drawings appear on the CRT. The screen has an area 
equivalent to 640 display positions, 16 horizontal rows and 40 vertical columns. 
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Information sufficient to fill the screen is available in microseconds from an 
internal random access disk. A light pen device is attached to the CRT and 
enables the learner to respond to displayed letters, figures, and graphics by 
touching an appropriate place in the screen. The coordinates of the lighted 
area touched are matched with the programed coordinates, and appropriate feed- 
back is displayed. A typewriter-like keyboard is attached to the CRT. A stu- 
dent responds by typing an answer which appears simultaneously on the CRT at a 
location on the CRT established beforehand by the course author. This response 
is matched against a prooramed response with the correct feedback given. Four 
dictionaries of 128 characters each can be used either in programing or for a 
student's response. This, for example, would make it possible to teach literacy 
skills using special phonemic alphabets such as the i.t.a. or the Trager and 
Smith phonemic alphabet. Also special symbols and designs can be used which 
are associated with particular Job areas. 

A second medium for presenting course material is the IBM 1512 image pro- 
jector. When loaded with a 16mm microfilm reel, the image projector is capable 
of showing 1,000 still photographic images in black and white, or oolor. The 
images can be individually accessed at the rate of 40 images per second under 
program control. The image projector has been a very valuable facility in 
teaching literacy skills. A reading selection is first presented sentence by 
sentence or small portion by portion on the CRT. As the student reads, he calls 
up new material by pressing the space-bar on the typewriter keyboard. When the 
student finishes reading the passage, he will be told the nuRt>er of words in 
the passage, how long in minutes and seconds it took him to read the passage, 
and his reading rate, that is, the number of words per minute he is reading. 
Gradually the student will be encouraged to increase his previous reading rate 
record. In order to ask the student questions and to provide him with learning 
activities from the reading, the image projector will now show the entire selec- 
tion with sentences numbered. As vocabulary, language skill, and comprehension 
questions appear on the CRT, the student can refer back to the reading selection 
in answering the questions, particularly if his first answer is an incorrect 
response. In such a case, the display on the CRT will tell the student to read 
a specific sentence on the image projector or to attempt the question again. 
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The Image projector has also been a very useful facility in offering career 
infoimatlon. The images are usi^d to simulate real job situations. In the 
mechanical worker selection, the photographer has gone right Into an automobile 
garage and photographed well organized and poorly organized tool boxes and tool 
boards. Nan, rebuilt, and broken automobile parts have been photographed. 
Some unpleasant and pleasant features of being an auto mechanic are illustrated 
with photographs. Pages from parts catalogues and order forms are also shown. 
The student is asked to answer factual, inferential* and problem solving ques- 
tions related to the pictures and the written discussion which accompanies the 
picture on the CRT. 

A third medium of presentation is the IBM 1506 audio pi ay/ record unit. 
By means of a four-track tape record head and compatible audio tapes* pre- 
recorded information is presented. The student can also record his response on 
one track and Immediately listen and compare his pre-recorded response. The 
audio messages are coordinated with the other instructional presentations on 
the CRT and the image projector. The audio pla^y/record unit has been a singu- 
larly Important facility in teaching literacy skills* particularly in the LITE I 
materials. In the development of about 70 percent of the LITE program, that 
which appears as displayed text materials also appears as spoken information for 
the student. In teaching sound to letter correspondence* the audio feature is 
used extensively. In giving directions the audio is used extensively with the 
reading of the same directions. At the beginning of the instruction in all of 
the LITE II units* some reading materials are Initially read aloud to the stu- 
dent while the student reads along. Gradually* this audio suoport is withdrawn 
so that the student is reading completely on his own. In the vocabulary and 
language skill activities* the student hears words and sentences as well as 
reads them. Simulated work situations and conversations are also recorded for 
listening/learning activities. The full potential of the audio play/record 
unit has been used for the program and is viable proof of the close connection 
between ear and eye in literacy development. 

Computer equipment to support the student stations is essential. The 
Central Processing Unit (CPU) provides storage of data containing the completed 
literacy development program and student record data. It is the nerve center 
directing activities of the components of the student station. 
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Configuration of the IBM 1500 system Is shown In Appendix A. 

Since the computer can record and recall student responses such as the 
nunfeer of correct answers » the number of wrong answers » time on-line or time to 
complete a passage » the sequence of Instruction for a particular student can 
be altered on the basis of his response. In the code-breaking » LITE portion 
of the program » and the basis of pre- and posttest Information, a student can 
either omit, review, or study Indepth, various sound and letter con61nat1ons. 
The student can read all or some of the orientation to the world of work 
reading selections. He can also spend varying lengths of time on these selec- 
tions. In this portion of the program, the student can also elect to partici- 
pate In, or omit alphabet Instruction. In the career-oriented, LITE II 
materials, the student can select career areas which reflect his Interest as 
revealed by the results of the Gordon Occupational Check List. 

In the research and development of the LITE project, the computer was used 
to record a variety of Information for all of the students participating In the 
development and the evaluation of the program. 

For the summative evaluation of these materials, computerized Information 
was recorded on: 

1. Length of time students stay on line for each Instructional period; 

2. Nunber of times students return to the computer for each Instructional 
period; 

3. Nunber of units conpleted In a recorded time period; 

4. Topics chosen most frequently; 

5. Entering reading level on pretest; 

6. NuRfeer passing phonics criterion test; 

7. Length of time In phonics material* LITE I; 

8. Length of time In reading pool materials* LITE I; 

9. Niniber of correct and wrong answers* first and second tries; 

10. Students meeting criterion levels: 90/90 vocabulary; 

11. Exit reading level in posttest; 

12. Nuriber of job areas selected per student. 
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For the formative evaluation of these materials, computerized information 
was recorded on: 

1. Length of time students stayed on-line for each instructional interval; 

2. Nijnber of times student returns to computer for each instructional 
period; 

3. Nuriber of units completed in a recorded time period; 

4. Topics chosen most frequently. 

An analysis of ^1s data shed light on the following developmental issues: 

1. Does the student learn new career information? 

2. Are more than two tries per item necessary for learning? 

3. Is readability (syntax and vocabulary) aopropriate for the content and 
goals of the program? 

4. Does Job information inciude duties, requirements, advantages and 
disadvantages? 

5. Does the organization of the reading selection and items aid the stu- 
dent's comprehension, vocabulary development, and language skill? 

6. Can 90 percent of the students demonstrate 90 percent knowledge of 
vocabulary? 

7. Can 80 percent of the students demonstrate 80 percent knowledge of 
comprehension? 

8. Can 70 percent of the students demonstrate 70 percent knowledge of 
language skill? 

9. Are comprehension questions mainly career specific? 
10. Are language skill items career specific? 
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CHAPTER FOUR 

COURSE DEVELOPMENT 

All of the course development activities undertaken In this project were 
devoted to the development and validation of a Computer-Assisted Literacy 
Development Program for Career-Oriented Youth. A number of specific tasks 
mn Involved In the development and validation of this program, each task was 
related to the overall purpose of the project. 

Task 1: 

Refinement of Course Description 

The first task undertaken by the princloal investigator artd the research 
assistants of the LITE program was the refinement and focus of the Course 
Description (Chapter Two of this report). The Course Description described the 
content to be covered in the course and it defined the strategies to be employed 
in presenting the materials. It provided the framework to which specific 
objectives were added for the next task. When completed, the Course Descrip- 
tion indicated the procedures that students would employ in becoming literate 
in career areas. 

This task of determining the course description and the student's flow 
through the course was one of our most tempestuous periods. Many decisions had 
to be made on sound and available Information: 

1. Uho would be our target population. I.e., who would be the audience 
reading our materials? 

2. Vlhat kinds of career information would hold the interest of these 
students? 

3. Mhat occupational information could these students use to their best 
advantage? 

4. What were the career expectations of these students? 

5. What teaching devices would interest these students? 

In order to answer these questions, many hours of consultation with specialists, 
teachers » prospective students, counselors, and administrators were needed. 
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Task 2: 

Specl^lnq Behavioral Qbjecti ves for 
Progrw Segments anT"Fraiiies 

A lajor step in the developiRent was the identification of the behavioral 
objectives for each segment of the course. This step was carried out with the 
principal investigator and the research assistants. Regular meetings of the 
LITE staff in total and individually were needed. These laeetings were important 
for the authors of the LITE material as well as the programers* since programers 
had to standardize much of the instructional materials, the coding, and the 
research design. 

The Course Development was used as the basis for developing specific 
objectives. Objectives and desired student behaviors and responses were deter- 
mined for each interaction between student and the CAI program. For each stu- 
dent response item there had to be a literacy objective as well as a career 
information objective. Each interactive frame required some response from the 
student. Correct answers were determined in advance and students were given 
feedback, clues, and further attempts at the problem. One major problem in 
determining course objectives was to determine and refine objectives so that 
they could be executed in a reasonable time period. In general, there was a 
tendenqy to overteach rather than to underteach. 

Task 3: 

Preparation of Program 
Material forlthe^CArTystem 

Full segments of the course material was given to specific authors and 
programers as follows: 

Phonemic Code-Breaking Segment - Ruby Thompson 
Work-world Orientation ^ Pat Mull 
LITE 0 and LITE I Material Programer - Tom Emery 
LITE II and tests programer - Marsha Young 
Orderly - Donna Pra11 and Maura Clancy 
Nurse Aide - Donna Prall and Maura Clancy 
Auto Mechanic - Lester Golub 
Waiter - Robert Caldwell 
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Chef - Robert Calckell 

File Cleric - Bill Beaman 

Receptionist - Maura Clancy 

Auto and Visual Technician - Bill BeaMn 

Although authors i«ere not expected to be prograroers. they did study enou^ 
programing Information of Coursewrlter II » to present the mterlal to the 
prograwrs on programing sheets so that maximum efficiency could be achieved 
between authors* programers and if^>ut technicians. 

As part of the developmental strategy* each author selected his unique 
mode of presentation. In that way It was possible for authors to share a 
variety of creative strategies for course presentation. 1he decision to develop 
materials with this wide latitude of instructional strategies was a healthy 
one since each unit* through an exchange of ideas and information* seemed to 
be developed more interestingly than the preceding one. 

The authoring of CAI course material is an exacting* laborious task. Each 
frame has to be carefully planned to meet its predetermined objective and to 
provide learner interaction and response with feedback. Ihe amount and the 
sequence of information must also be controlled carefully. Miscalculations in 
autiioring are hard to detennine until a student actually sits down at the stu- 
dent station and attempts the instructional materials. 

It was essential that an efficient procedure for processing authored mate- 
rial from author to programer and back to author again* since the writing and 
programing of program materials takes up most of the time in this phase of 
course development. The Insertion and production of image statements and audio 
stat^nents must be carefully transmitted to the technicians who must translate 
the author's ideas into usable curriculum materials. Procedures for coding of 
questions and drill items had to be settled early. 

The procedure for producing CAI materials for the LITE program included 
four basic steps. First* the author wrote out Instructional units as well as 
directions to the programed on specially designed program sheets. Each . 
author was provided with two to five hours of instruction in programing 
Coursewriter II* a simple computer language used for computer assisted 
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instruction. Special directions to the prograiers usually concerned the p1ace> 
nent of images and audio messages, the format and content of images, and the 
location of branching statements and blocking of information presented to the 
student. 

In the second st^. the programer edited the instructional text for the 
key punch operator. At this time the programer cleared up illegibilities, 
typographical and other mechanical problems. By the time a handwritten corpus 
of instructional material goes from author to project director to author to 
typist to programer to key punch operator and ready for initial display in the 
IBM 1500, many unforseen changes can take place in the content, language and 
format of the materials. As experience was gained, the procedure progressed 
very rapidly and some savings were gained. Uhen the performance level of 
author, programer, and key punch operator is high, maximum production can be 
achieved. It is at this point that production should continue as long as 
possible without change in personnel. It would be wise to have more than one 
funded project operating at this high peak of efficiency. Error free results 
at this stage of development is essential since "debugging" of CAI materials 
is costly and time consuning. On the other hand, error free results are almost 
an unattainable objective. 

In step three, the key punch operator, using the edited program sheets, 
prepared v\ initial deck of punched cards. Ihese cards consiste<i mainly of 
textual materials and the Coursewrlter II program statements. 

The fourth step consisted of deck-building and debugging by the programer. 
In deck building, the programer inserted the Coursewrlter statements into the 
contextual materials and edited some of the contextual cards. After the deck 
for one unit was completed, it was assembled into the computer and the programer 
could then put the contextual material through a process of on-line debugging. 
In this step the objective was tc insure that assembled course material and 
and course flow corresponded to the specifications laid down by the author. 
The author was called into work with the programer at this stage of the program 
development. 
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Task 4: 

Testiiig and Revising 

the i^roqram ; Formative Evaluation 

In the development of the LITE program, testing and revision occur continu- 
ously throughout the various phases of course development. Revision of objec- 
tives and material occured before the content was translated into programing 
language. Before a segment of the LITE program was given to a programer» the 
author first had both the project director and the project co-ordinator read 
the materials for revisions. During the programing of the course content, 
materials were revised since some suggestions of the author may be unclear or 
impossible to carry out or^ the IBM 1500 computer system. Revlstfon also occurs 
during the initia> debugging of the course. At this point, the author and the 
programer must "take" the course they have authored and programed. During this 
"course taking," they must also mike as many mistakes as possible so that they 
can check the course for sequencing and content. 

The formative stage ov revision began as soon as enough segments of the 
program were available to make bussing of subjects from their community to The 
Pennsylvania State University campus financially feasible. At this time one 
illiterate. University janitor was given two hours a week of his work time to 
come to the CAI Laboratory to develop his literacy skills. He is still working 
in the program and other janitors have requested to use the program. Once again 
the problem is one of time and money. 

For the formative evaluation, about ten students were used to provide 
infbrmation for the revision of the Initial program. This formative evaluation 
and consequential revision took place during the winter quarter, 1973. To 
assure maximum use of this developmental procedure, a system for recording and 
revising errors was devised. Each student in this pilot group was accompanied 
by an author who recorded, on 4 x 6-inch cards, the student's comments and ques- 
tions on the program and the bugs of the program such as errors in the CRT 
displays, graphic displays, images, and audio messages. Program revisions went 
to the programer, content revisions to the author and then to the programer. 
Such items as type of errors, number of errors, number of requests for help, 
response latencies, and other information were analyzed to pinpoint problems in 
content, pedagogy, and programing. 
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Careful revision and sequencing of the LITE program followed the formative 
evaluation. By Spring quarter, 1973» the summative evaluation took place with 
about forty illiterate and semi-literate high school students participating. 
These students also completed an attitude evaluation form at the completion of 
their time on the program. 

Documentation 

The LITE program is a thoroughly "documented" CAI course The word "docu- 
ment" refers to a complete printed version, and a computer readable version on 
computer magnetic tape, of not only the course content and strategies but to 
other more specialized types of information. Documentation of this course is 
an absolute necessity since there are no student or teacher handbooks to 
accompany the course. To a great extent, documentation of this course will 
provide valuable author and programing Information to persons wanting to continue 
with this type of program, but who will not want duplicate the work already 
completed. 

The purpose of the documentation Is to provide information to at least 
three types of audiences: 1) administrators and prospective users of the pro- 
gram, 2) instructors who want to be familiar with the course content, and 3) 
authors and programers. Administrators will be Interested in purchasing and 
curriculum planning. These persons will be Interested in course content and 
how it fits the needs of their students and how It can be plugged into existing 
curriculum designs. Instructors will be concerned with the accuracy and appro- 
priateness of the course content, teaching strategies, and the Instructional 
media involved. Programers will be interested In the documentation for its 
innovative programing strategies. 

The documentation for the LITE program is divided into three sections. 
Section one consists of representations of the cathode ray tube (CRT) displays. 
Along with each screen display, there are descriptions of answer processing 
procedures as well as descriptions of activities at a student station; the 
positioning of images (and their numbers), the closing of the image shutter, 
positioning andjJisp^ajfyiq^ of audio messages (and their names), descriptions of 
response limits, and the coded response identifiers. The answer mode, keyboard 
or light pen, is also indicated. 
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The CRT display dominates each page of printout. It is framed on the left 
by a column of nurrbers corresponding to screen rows and at the top by the 
number of screen columns. Within this frame apnears exactly what the student 
sees on the CRT. Though graohics also apoear, the system can provide only near 
representations. This section of the documentation offers a sequential and 
graphic representation of the LITE program. Portions of section one of the 
documentation can be found in Appendix B. 

Sections two and three of the documentation are of use to programers and 
systems personnel. Section two is the coding section containinq a comolete 
list of Coursewriter II statements similar to the listing used by the programers 
during the course development. Section three is a complete cross-reference 
table showing not only which audio messages, buffers, counters, functions, film 
images, and labels have been used but also where they had been used with resoect 
to course labels. This cross reference section is an invaluable tool for pro- 
gramers. With it they can immediately locate any of the above listed items 
(audio and image printouts) in any part of a course. The documentation program 
also has printed out all of the audio messages and summary descriptions of all 
-the images in the LITE program. These appear, segment by segment, at the end 
of the three documented sections of the LITE program. Audio messages are first, 
in alphabetical order, followed by images in numerical order. 

In the initial proposal for this project it was thought that a teacher's 
manual might be necessary for the program. The principal investigator now 
believes that with section one of the documentation, such a manual is unneces- 
sary since the course is relatively "teacher-proof," self -administering, and 
self-pacing. 

For research purposes, the programed text version of the CHEF portion of 
LITE II was constructed to parallel as closely as possible the same material 
in the computer mode. 

Copies of the LITE DOCUMENTATION are available under separate cover. 
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CHAPTER FIVE 

PROGRAM EVALUATION 

The Evaluation of the Literacy Development Project centered on several 
basic questions: 

1. Can computer assisted instruction adapt learning to the varying needs 
and abilities of illiterate and semi-literate learners so that significant 
gains in reading achievement result? 

2. Will reading instruction under computer control create favorable 
attitudes in the learner toward instruction? 

3. Does computer assisted instruction offer unique instruction advantages 
not offered in a programed text? 

Three instruments were used to answer these questions. To measure over-all 
achievement on computer assisted presentations of LITE I and LITE II, two forms 
of the Adult Basic Literacy Examination (ABLE) were used. This is a standardized 
text developed by Harcourt, Brace, Jovancvich and is based on national achieve- 
ment norms. 

Learner achievement on the CAI and programed text presentations of the 
Literacy materials was comoared using a 31 item criterion-referenced achievement 
test. This test was directed at assessing achievement of vocabulary, comorehension, 
and word skill objectives as they were specified in the occupational unit of 
chef. (See Appendix A) 

Attitudes toward the CAI and programed text versions of the learning 
materials were measured using a semantic differential. This instrument is 
essentially a combination of controlled association and scaling procedures. 
The subject is presented a concept to be differentiated using a set of popular 
adjectives, his task is to indicate for each item the direction of his 
association and its intensity on a seven-step scale. (See p. 45) 

Professional Co nsultati on 

The Literacy Development Project was developed through numerous conferences 
and consultations with a wide variety of specialized individuals and resources. 
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The theoretical framework of the program was founded in previous research 
reported by Uansen (1971 )» Charp and Sandstorm (1968), Fletcher and Atkinson 
(1972), riynhier (1969), Hankin, Smith, and Smith (1967), and Cole (1971). 
These reports described a variety of computer-directed reading programs, 
extending from remedial and developmental uses through special education 
programs with illiterates. The success of these programs lent encouraginq 
support to the notion that computer assisted instruction could be adopted to 
the varying abilities and needs of illiterates and semi -literates. 

Instructional content was derived from several sources of occupational 
information and Adult Basic Education Curricula. Some of the more useful 
ones included: 

1. Pennscrlpt 

2. Prentice-Hall Adult Education Series 

3. Uoppock, R. Occupational Information . New York: McGraw-Hill 

Book Company, i967. 

4. Occupational Outlook Handbook 1972-73 . U.S. Department of Labor, 

Bureau of Labor Statistics Bulletin 1700, Washington, 
D.C.: U.S. Government Printing Office, 1972. 
Strategies of reading instruction were planned under the direction of 
Professor Lester S. Golub and were translated into computer compatible format 
by a number of language arts and technical specialists. Donna Prall, Maura Clancy, 
Ruby Thompson, Patricia Mull, Margaret Hubicsak, Uilliam Beaman, and Robert 
Caldwell were the reading and language specialists employed to author instruct- 
ional materials. These materials were then programed and prepared for on-line 
use at the computer terminal by the following technical support people: 
Professor Karl Borman, technical support manager; Marsha Young, Thomas Emery and 
Carolyn Kendall, progv^amers; Terry Bohn, computer operator; and Leslye Bloom, 
computer graphic artist. 

Formative Evaluation 

Formative evaluation was conducted from January to February, 1973 using 
a total of twenty (20) students enlisted from high schools located in the 
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Centre County of Pennsylvania. Five students per session were transported 
to The Pennsylvania State University Computer Assisted Instruction Laboratory 
from each of four area school districts: State College. Bellefonte, Bald 
Eagle, and Penns Valley. These students were most helpful in providing 
feedback for tiiodification of the program. Data gathered from this evaluation 
provided information on 1) diagnostic and evaluative test item difficulty, 
2) instructional time required for each learning segment, 3) effectiveness of 
test material and administration time, 4) amount of new career information 
provided, 5) career specificity of vocabulary, comprehension, and language 
skill objectives. 

Data were collected in two ways. Item analysis and instructional items 
were automatically recorded by the computer. These data were later analyzed 
by the programers and course authors to determine where revisions would be 
appropriate. Further evaluative information was collected by individual 
course authors who sat through the learning sequence with individual learners 
and kept written records of learner reactions, problems encountered and 
suggestions for revisions. Editorial changes were made in the program as a 
result of this evaluation and provided a basis for a successful summative 
evaluation. 

Summative Evaluation 

Actual online instruction using the literacy materials began on April 23, 
1973. Thirty-seven (37) learners (not used in the formative evaluation) were 
enlisted from the Centre County, PA. high schools. These subjects ranged In age 
from 14 to 18 and were identified by their respective guidance counselors as 
having reading levels below fifth grade. Unfortunately, these grade placements 
were determined by separate reading achievement tests used in individual school 
districts and, as a result, provided no standard determination of grade level. 
It was assumed, however, that these school districts used valid evaluation 
instruments for assessing student abilitiies and that for this reason the 
population used represented a valid sample of semi-literate adolescents. 

Students from Bald Eagle, Bellefonte, and Penns Valley were transported 
to The Pennsylvania State University Computer Assisted Instruction Laboratory 
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once a week for a two hour session for a oeriod of 7 weeks. Ourinq this time, 
learners worked at their own rate throuqh an Instructional sequence determined 
by their Individual response histories. Students from State College High School 
followed a similar procedure but instead attended a one hour session twice a 
week. 

The students' progression through the instructional and evaluative pro- 
cedures are sunroarized in the flowchart presented in Figure 3. All subjects 
entering the program were given the Select ABLE test to diagnose their entering 
reading level. A score of 15 or below on this test determined that the 
learner's reading level was below third grade and he was moved into LITE I. 
Here he was given ABLE I, Form A as a pretest and then set to work on the LITE I 
materials. If his score was above 15, he was directed into LITE II and given 
ABLE II, Form A as a pretest. 

Mhen a student completed his respective instructional programs, he was 
given Form B of the appropriate ABLE exam as a posttest. If a student taking 
ABLE I did not reach at least third grade r&ading level, he was given the 
^opportunity to go back through the proper remedial channels in LITE I to reach 
this level. If he was successful in reaching third grade mastery, he could ^ 
then go on to LITE II. A learner comoleting LITE II followed a similar plan 
only he could leave the program when reaching the sixth grade reading level. 

Complete data were collected on 23 students and these are reported in 
Table 1. It can be seen that gains in reading achievement did occur, but they 
were not found to be significant when subjected to statistical analysis. Two 
important considerations must be kept in mind, however, im interpreting these 
results. First, these data represent the efforts of only 8-10 hours of 
instruction. Also, evaluation was based on a norm-referenced achievement test 
which was only incidentally related to the subject matter tasks. Taking this 
into account, it is not surprising that differences in pretest and posttest 
achievement are not significant, although it is encouraging that some gain was 
evident. 

If reading improvement continued at this rate for 160 hours, students 
would have completed full mastery of the posttests. 
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Select 
ABLE 



Lite I 
Pretest 
ABLE I 
Form A 



NO 



Lite I 
Instruction 



Posttest 
ABLE I 
Form B 





Lite II 
Pretest 
ABLE II 
Form A 



Lite II 
Instruction 



Posttest 
ABLE II 
Form B 



NO 



YES 




Fig. 3. Decision chart. 
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Table 1 

Reading Achievement on LITE I and LITE II 
as Measured by Pre and Posttest Forms of 
ABLE I and ABLE II. 







Pretest 


Posttest 




LITE Segnent 


N 


Mean 


SO 


Mean 


SO 


Significance Level 


LITE I 


4 


73.50 


8.20 


78.00 


5.28 


P < .05 


LITE II 


19 


76.16 


9.05 


77.05 


4.89 


P < .05 


Combined 














LITE I & II 


23 


75.69 


8.11 


77.21 


4.56 


P^ < .05 



A better Indication of the program's effoct on reading achievement can 
be determined from examining data collected from a 31 item criterion-referenced 
test Mhlch was part of the LITE II materials. Pretest and Posttest means 
obtained from this measure are reported In Table 2. 



Table 2 

Pretest and Posttest Reading Achievement 
on the Unit of Chef. 



Pretest Posttest Total 

Mean SD Mean SD Value 



18 19.17 4.22 22.22 3.28 3.92* 

Significant at the .005 level. 



As the data shows* significant differences between pretest and posttest 
achievement were found when evaluation was based more specifically on the specified 
objectives of the program. 
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To further evaluate the effectiveness of the ccmnuter assisted nronram* 
It was In part contrasted with a oresentatlon of the same LITE Content In a 
programed text. A portion of the LITE II materials on the occuoatlon of chef 
was presented In a nroqramed text to 35 students at Phlllosburq H1<)jh School who 
had been Identified semi-literate and to IB students uslnq these materials on 
the computer. Iheir achievement was assessed usinq the 31 Item criterion- 
referenced test mentioned above. The results are summarized In Tables 3 and 5. 



Table 3 

Readinq Achievement Pretest and Posttest 
Means for CAI and PI Presentations. 





N 


Pretest 


Posttest 


Groups 


Mean 


SD 


fiean SD 


CAI 


18 


19.17 


4.22 


22.22 3.28 


PI 


35 


20.09 


3.87 


23.54 4.69 



Preliminary examination of these data seemed to Indicate that both grouns 
learned from the Individual treatments but that neither the comnuter assisted 
presentation nor the programed text was more successful than the other In bring- 
ing about significant achievement gains. 

Analysis of these data using an Analysis of Variance with Repeated Measures 
(ANOVR) confirmed these Initial assumptions. The ANOVR data summarized In 
Table 4 Indicates first of all that there was no significant difference In the 
ma?n effect for treatment; the nonsignificant F ratio of 1.07 slnDly means that 
the group using the computer-assisted program did not differ significantly from 
the programed text group on either oretest or oosttest scores. 

Interaction between achievement and treatment yielded a nonsignificant F of 
•15 Indicating that neither the computer-based dlsolay nor the programed text 
had a differential effect on achievement. However, an F ratio of 43.31 found 
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significant at the .001 level Indicated that differences In pretest and oosttest 
achievement Mere significant for each group. Uhat these ffle&n, then. Is that the 
self-Instructional reading program was successful In '.'Rising student achievement 
on specific criterion skills In both a programed text and In a computer assisted 
presentation, but neither method proved more successful than the otiier In bringing 
about these achievement gains. 



Table 4 

Analysis of Variance (ANOVR) on Pretest and 
Posttest Reading Achievement Scores. 



Score of 
Variation 


d.f. 


Sun of 
Squares 


Mean 
Squares 


F Ratio 


Between Subjects 










Treatment 


1 


29.81 


29.81 


1.07 n.s. 


Error 


51 


1421.23 


27.87 




Within Subjects 










Achievement 


1 


292.23 


292.23 


46.31*** 


Interaction 


1 


.96 


.96 


.15 n.s. 


Error 


51 


6.31 







Significant at the .001 level. 



To further corroborate the significant differences between pre- and 
posttest achievement made apparent by the ANOVR, dependent t tests were performed 
on the pretest and posttest means of the programed text and the CAI groups. 
Results of these tests are sumnarlzed In 'lable 5. 

t values of 3.92 for the CAI group and 5.66 for the PI group at the .005 
level clearly Indicate that differences In pretest and posttest achievement for 
each group were significant. It can ba assumed » therefore, that the observed 
differences In achievement from pretest to posttest were the result of the 
instructional treatment presented In a computer-based dispaly unit and In a 
programed text. 
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Table 5 

t Tests for the Difference Betureen Pretest and 
Posttest Means for CAI and PI 
Reading Achleveaent. 











Pretest 


Posttest 




Group 


N 


d.f. 


Hean 


SD 


nean 


SD 


t Value 


CAI 


18 


17 


19.17 


4.22 


22.22 


3.28 


3.92* 


PI 


35 


34 


20.09 


3.87 


23.54 


4.69 


5.66* 



Significant at the .005 level. 



Sunmatlve evaluation revealed not only an Increase In general reading 
achievement but also Indicated an extremely high level of student understanding 
of career Information. Table 6 reports the mean scores on measures of career 
Information comprehension. 



Table 6 

Mean Percentage of Career Information Comprehension With 
80 Percent as Established Criterion Level. 







Percent of Comprehension 




Career 


Items Answered Correctly 


Number of Comprehension 


Selection 


on First Try Response 


Items In Each Selection 


Orderly 


88.83 


N - 29 


Nurses Aide 


89.53 


N - 43 


Chef 


84.26 


N » 19 


Walter 


87.18 


N « 11 


File Clerk 


90.94 


N « 52 


Receptionist 


98.43 


N - 71 


Mechanical Worker 


70.73 


N - 15 
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Posttreatment attitude measures are sunmarlzed in Table 7. Upper and Imer 
limits of positive and negative attitudes can be refertficed on the following 
scale: 



Table 7 



Means and Standard Deviations of CAI and 
PI Attitude Scores on the 
Semantic Differential. 





Group 


N 


Mean 


SD 


d.f. 


t Value 


CAI 
PI 


17 
38 


136.29 
118.29 


25.8 
14.16 


54 


2.85* 



Extremely 

Negative 

Attitudes 

25 



Neutral 
Attitudes 

100 



Extremely 

Positive 

Attitudes 

175 



p < .05 



Using this scale, it becomes obvious from examining the means reported In 
Table 7 that students using the CAI presentation of the literacy program and those 
using the programed text had relatively positive attitudes toward the medium they 
used. A comparison of these means using a t test for Independent groups, 
however. Indicated that attitudes of semi -1 1 terate adolescents using the 
cofl^uter-based display unit were significantly higher at the .05 level than 
attitudes of those semi -literate adolescents using a programed text. 

A further comparison of student attitudes toward the computer-based dlsolay 
unit and the programed text was nade by calculating mean responses to each Item 
for both groups on the semantic differential. These 25 Item means along with 
their respective standard deviations were then subjected to t tests to 
determine on which items these two groups differed significantly. Item means, 
standard deviations, and resulting t values are reported in Tab^e 9. 
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Minus t values reported In Table 9 represented items which were responded 
to more favorably by the programed text group than by the CAI group. A1so» 
significance levels are reported at three 1eve1s» .05, .01, and .001. Examining 
these data. It can be seen that the PI students differed significantly from the 
CAI group on only two items: '^easy-hard*' and ''fast-s How''. Ihe remaining 15 
items for which significant t values were found indicate more favorable attitudes 
for the CAI group. Table 8 summarized the specific concepts to which the CAI 
group responded more positively and at which levels of significance. 



Table 8 

Specific Concepts to Which CAI Students 
Responded More Positively Than PI Students. 



.001 


.01 . 


.05 


exciting 


alive 


enjoy 


interesting 


like 


important 


necessary 


rewarding 


certain 


meaningful 




good 


valuable 




flexible 


ef f ecti ve 






relaxing 







It is interesting to note that out of 17 items which were found to represent 
significantly favorable attitudes toward a mode of instruction, 88 percent of them 
favored the CAI group. It is also interesting to examine how each of these 
groups responded to certain specific categories on the Sismantic ^differential . On 
the choice of "interesting-boring," for example, 70 percent of the CAI group found 
the program extremely or very interesting while none found it extremely or 
very boring. Comparing this to the reaction of tiie PI group on the same item. 
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only 36.8 percent found the programed text version extremely or very 
interesting and 28.9 percent found it very or extremely boring. Similar 
comparisons can be seen in Table 10 and are offered here only to underscore 
the significant differences fbund in the attitudes of the CAI and PI groups. 

A Student Performance Sunmary (SPS) chart was maintained daily on 
student progress through the LITE program. Data were collected on the following: 
1) student number (USER), 2) segment number (SEG), 3) minutes on line (MIN), 
4) comprehension items correct (C6), 5) vocabulary items correct (C7), 6) language 
skill items correct (C8), 7) co^rehension items tried (C9), 8) vocabulary items 
tHed (CIO), 9) language skill items tried (Cll), 10) Select ABLE number of 
items correct (C20), 11) ABLE number of vocabulary items correct (C21), and 
12) ABLE number of reading items correct (22). Appendix B contains one sample 
of an early Student Performance Summary Sheet, dated 04-27-1973, and the 
last Student Performance Summary Sheet, 06-04-1973. 
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CHAPTER SIX 

SUMMARY AND RECOMMENDATIONS 

The purpose of this project was to develop and validate a computer 
assisted literacy development program for career-oriented youths (ages 14-24). 
This goal has been accomplished, not In a complete sense, but it has established 
a model for a total computerized reading program for career-oriented young 
adults. 

The end product of this program consists of a completely computerized 
reading program which will diagnose reading level, occupational Interest and 
provide literacy and occupational Instruction at a literacy level of grades 
1-6. Under separate funding arrangements, the LITE program (LITE for the 
first four letters of liter acy) Is being offered to special education students 
In the adult basic education at Elywin Institute, a Pennsylvania school for the 
mentally retarded. Also some adult Illiterates on and near the Pennsylvania 
State University are taking the course. 

Several stages of development were required to produce the LITE program. 
First, an Intensive review of the relevant literature on career information 
and adult literacy teaching was carried out. Subsequent program development 
WuS carried out and decisions made at the Initial conception of the program. 
As the course authors prepared the sequence of testing and Instruction, the 
educational programers translated the materials into Coursewriter II for use 
witti the IBM 1500 Instructional System. After a pilot group participated in a 
formative evaluation of the program, revisions were made and another group 
participated in the summative evaluation. 

The summative evaluation showed that students participating in the LITE 
program made considerable gains in their literacy level and outstanding gains 
in knowledge of career Information. A comparison of students using a programed 
test and those using CAI instruction showed the attitude of the CAI group to the 
CAI mode significantly more favorable than those taking the programed test 
portion. 
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Some Recommendations 

1) Since the program is successful, funds should be found to implement 
the existing program either at The Pennsylvania State University 
CAI Laboratory or in the Penn State Mobile CAI Van, 

2) LITE I materials are extremely effective. The orientation to the 
world of work reading pool in LITE I should be expanded to meet the 
needs of adult basic education persons, special education persons, 
disadvantaged adults, and prison inmates. 

3) LITE II materials are extremely effective. More materials should be 
developed to niaet the career interests of special groups of young 
adults and that will extend the literacy range of the program to at 
least a tenth grade level. 

4) Teachers should become informed of the content and instructional 
strategies for the program so that parallel materials can be 
introduced Into secondary and adult reading classrooms where computer 
assisted instruction is not yet available. 
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APPENDIX A 
IBM 1500 SYSTEM CONFIGURATION 
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STUDENT PERFORMANCE SUMMARY SHEETS 
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